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WHAT  IS  THE  WORST  CASE  BEHAVIOR  OF  THE  SIMPLEX  METHOD?  ~ 


ABSTRACT 


The  examples  published  by  Klee  and  Minty  in  1972  do  not  _ L 

preclude  the  existence  of  a  pivot  rule  which  will  make  the  simplex 
method,  at  worst,  polynomial.  In  fact,  the  continuing  success  of 
Dantzig's  method  suggests  that  such  a  rule  does  exist. 

A  study  of  known  examples  shows  that  a)  those  which  use 
"selective"  pivot  rules  require  exponentially  large  coefficients, 
and  b)  none  of  the  examples'  pivot  rules  are  typically  used  in 
practice,  either  because  of  computational  requirements  or  due  to  a 
lack  of  even-handed  movement  through  the  column  set. 

In  all  "bad"  problems,  certain  improving  columns  are  entered 
m_2 

^  2  times  before  other  improving  columns  are  entered  once.  This 

is  done  by  making  the  unused  columns  "appear"  to  yield  small 
objective  function  improvement. 

The  purpose  of  this  paper  is  to  explain  the  Klee-Minty  and 
Jeroslow  constructions,  show  how  they  can  be  modified  to  be 
pathological  with  small  integral  coefficients,  and  then  suggest  a 
"least  entered"  pivot  rule  which  forces  an  improving  column  to  be 
entered  before  any  other  column  is  entered  for  the  second  time. 

This  rule  seems  immune  to  the  "deformed  product  construction"  which 
is  the  essence  of  all  known  exponential  counterexamples.. 


jjj.1 ,  _ _ 
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Introduction 


The  simplex  method  has  been  solving  linear  programs  with  m 
constraints  in  m  to  3m  pivots  for  over  twenty  years.  In  1972, 
Klee  and  Minty  demonstrated  the  existence  of  linear  programs  with 


m  inequality  constraints  in  m  non-negative  variables  which  require 
2m_l  pivots  when  any  improving  column  may  enter  and  when  the 


standard  "max  c^-z."  rule  is  followed.  Applying  their  construction 
1 

for  the  standard  rule  leads  to  coefficients  in  excess  of  3m. 


In  1973,  Jeroslow  published  a  modification  of  a  second  Klee 


and  Minty  construction.  His  modification  is  pathological  for  the 
"maximum  increase"  rule.  An  unrefined  application  of  this  construction 
also  yields  exponential  coefficients. 


Other  examples  involving  large  coefficients  were  subsequently 
published  by  Zadeh  [1973]  for  minimum  cost  network  flow  problems, 
Avis-Chvatal  [1977]  for  Bland's  rule  (first  positive),  Murty  [1978] 
and  Fathi  [1978]  for  complementary  pivot  algorithms,  and  Goldfarb- 
Sit  [1980]  for  a  "gradient"  selection  rule.  An  example  due  to 
Edmonds  for  shortest  path  computations  is  also  known  [4]. 


The  above  examples  may  be  viewed  as  "deformed  product  constructions. 
Given  a  polytope  pm  requiring  2m  pivots  with  a  polynomial 
number  of  dimensions,  a  new  polytope  P  is  constructed  by  deforming 
a  product  P™  x  v,  where  V  is  some  polytope  usually  of  low  dimension. 

In  the  first  Klee-Minty  construction,  pm+^  differed  from  Pm  by  one 
dimension  and  two  facets  (V  has  one  dimension  and  two  facets).  In 


2 


the  Klee-Minty-Jeroslow  construction,  pm+^'  differed  from  Pm  by 

two  dimensions  and  roughly  4k  facets,  where  k  is  some  positive 

m+1 

integer.  In  the  network  constructions  [16],  P  differed  from 
Pm  by  2m  dimensions  and  2nri-4  facets. 

We  show  that  any  linear  program  with  rational  coefficients 
may  be  expressed  with  coefficients  0,  1,  -1,  and  2.  Modifications 
of  the  Klee-Minty  and  Jeroslow  constructions  are  given  with  integral 
coefficients  no  greater  than  four.  The  Klee-Minty  examples  are 
shown  to  be  equivalent  to  resource  allocation  problems  with  non¬ 
negative  coefficients  in  which  all  bases  have  determinants  of  +1. 

In  all  "bad"  examples,  the  coefficients  are  chosen  so  that  the 
best  columns  price  out  moderately,  and  are  not  entered  until  other 
columns  have  been  entered  exponentially  many  times.  Roughly  speaking, 
for  a  deformed  product  P11^1  w  Pm  x  v”1,  this  means  that  the  simplex 
method  performs  a  2m  step  pivot  sequence  for  Pm  before  entering 
any  of  the  new  variables  associated  with  V™.  The  pivot  sequence 
for  Pm  is  then  performed  again  in  the  reverse  order. 

Geometrically,  the  simplex  method  stays  on  a  lower  Pm  face  of 
pm  x  v™  for  =3  2m  pivots,  then  moves  through  the  added  V™  dimensions 
to  an  "upper"  Pm  face  where  it  spends  another  2m  pivots  "undoing" 
pivots  performed  on  the  lower  face. 

Entering  variables  from  V™  early  causes  a  permanent  move  away 
from  the  lower  face,  killing  the  exponential  growth. 

The  following  rule  forces  movements  away  from  faces  irrespective 
of  the  level  or  rate  of  improvement.  It  was  considered  primarily  for 
theoretical  purposes  after  a  thought  provoking  conversation  with  Arthur 


F.  Veinott,  Jr. 


Least  entered  rule:  Enter  the  improving  variable  which  has  been 
entered  least  often. 

The  above  rule  is  easy  to  implement,  and  when  used  in  conjunction 

with  the  standard  or  "max  increase"  rules  speeds  up  both.  It  is 

unlikely  to  cycle  (the  cycle  must  contain  all  improving  columns) . 

It  is  our  hope  that  the  rule  will  prove  to  have  a  worst  case  bound 

proportional  to  m-n,  where  m  is  the  number  of  rows  and  n  is 

* 

che  number  of  columns.  Examples  of  maximum  flow  problems  requiring 

m-n  pivots  using  this  rule  will  be  given  in  a  forthcoming  paper. 

Other  rules  similar  to  the  "least  entered"  rule  which  have  been 

suggested  [4]  are  the  Least  Recently  Considered  (LRC)  rule  of 

Cunningham  and  the  Least  Recently  Basic  (LRB)  rule  of  E.L.  Johnson. 

Both  methods  were  apparently  designed  for  shortest  path  computations 

in  networks  but  have  obvious  extensions  to  general  linear  programming 

which  would  kill  the  exponential  growth  of  known  counterexamples. 

Unfortunately,  polynomial  proofs  for  the  above  rules,  if  they 

exist,  might  be  extremely  hard,  as  they  would  reduce  the  current  best 

1  d-2  5 

bound  for  the  diameters  of  polytopes  from  -j  •  2  (n  -  d  +  y)  to  a 
polynomial  in  n  and  d,  where  n  is  the  number  of  facets  and  d, 
the  dimension. 


This  is  similar  to  the  old  conjecture  S(d,n)  ^  (d-l)(n-d)  +1 
of  Klee  [12]  which  was  proven  false  by  Klee  and  Minty  for  the 
standard  rule. 
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The  Klee-Minty  Construction 

The  first  Klee-Minty  construction  creates  from  an  n-dimensional 
polytope  Pn  with  2n  faces  requiring  2n-l  pivots  when  any 
improving  column  may  enter  a  polytope  Pn+^  with  two  more  faces 
requiring  2n+3-l  pivots. 

The  construction  is  illustrated  in  Figure  1.  The  path  of 

vertices  visited  in  Pn  is  denoted  pft»  p. ,  . . . ,  p  .  The  first 

l  2n-l 

polytope  PA  has  two  faces  (x^  2  xi  —  and  requires  one  pivot. 

2  1 

The  second  polytope  P  is  obtained  from  P  by  adding  two  additional 
constraints  -x^/3  +  x^  >  0  and  x^/3  +  <_  1,  involving  one 

additional  variable. 

2 

It  is  convenient  to  think  of  the  pivot  sequence  for  P  in  terms 

of  the  slack  variables  associated  with  the  various  faces.  The 

initial  point  p^  ■  (0,0)  is  determined  by  S2»  basic,  s^,  s^ 

non-basic.  The  sequence  p^,  p^,  p£>  corresponds  to  entering 

s^  then  s^,  and  then  s^.  The  variables  s^ ,  s^  and  s^  are 

respectively  deleted. 

3  2 

P  is  obtained  from  P  by  adding  two  more  constraints  involving 

one  additional  variable.  Note  in  Figure  1  that  the  pivot  sequence 

3  2 

for  P  is  essentially  the  pivot  sequence  for  P  ,  plus  a  movement 

2 

from  the  lower  face,  followed  by  the  sequence  for  P  in  the  reverse 
order.  We  express  this  pheomenon  in  general  by  writing 
P11*1  ■  Pn,  S2n+^,  1?n.  In  terms  of  entering  slack  variables, 

P3  -  SjS^  S5  SjS^. 


mmm i mm 


(0,1,0)  —  X2  (0,0,0) 

Pivot  sequence: 

No.  2  S1  S3  S2 

No.  3  S-j  S3  Sj  Sg  S-j  S4  S2 

No.  4  S-j  S3  S2  Sg  S-j  S4  S2  Sy  S3  S2  Sg  S^  S4  S2 


Figure  1:  An  example  of  the  Klee-Minty  construction 


T 


Fooling  the  Standard  Rule 

The  examples  in  Figure  1  take  one  pivot  to  solve  when  the 
standard  max  cj-zj  rule  is  employed.  To  fool  this  rule,  Klee  and 
Minty  scale  the  variables  so  that  a  much  larger  change  in  the  entering 
slack  variable  is  required  to  achieve  the  same  objective  function 
change,  or  equivalently,  to  move  to  the  same  adjacent  vertex. 

As  an  illustration,  let  c(s^)  denote  the  relative  cost  factor 
for  s^.  If  Af.^  denotes  the  change  in  the  objective  when  s^  is 
entered,  then  c^)  =  Af^/As^  At  p^  =  (0,0,0)  in  Figure  1, 
cCs^)  =  1/9,  c(s2>  =  1/3,  and  c(s^)  =  1.  The  standard  rule  would 
enter  s_,  moving  from  (0,0,0)  to  (0,0,1),  the  optimum,  in  one 
pivot.  However,  if  s^  were  replaced  by  s^/16,  it  would  take  a 
16  unit  change  in  s^  to  move  from  (0,0,0)  to  (0,0,1)  and 
c(s^)  would  be  1/16.  A  similar  replacment  of  s^  by  s2/4  would 
cause  the  standard  rule  to  enter  s^  and  follow  the  same  sequence 
as  before. 

The  right  hand  side  of  Table  1  gives  a  scaling  which  will  make 

the  standard  rule  exponential.  Note  that  the  coefficients  grow  at 

„  ,  .m 

a  rate  of  4  . 
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Examples  with  Small  Integral  Coefficients 
The  large  coefficients  in  expressions  like  s0/64,  or  more 

O 

generally,  s2n^n  be  eliminated  by  adding  n-1  additional 

variables  and  constraints.  For  the  case  s_/64,  we  replace  s_ 

o  o 

by  Sg  with  the  additional  constraints  4Sg  -  s'g  =  0,  4sg  -  s'g  =  0, 
4s'g'  -  Sg  ■  0,  Sg,  s'g,  s'g'  >  0,  as  done  in  Table  1.  To  construct 
Pm  in  this  fashion  using  coefficients  no  greater  than  4,  m(m-l) 
constraints  and  non-negative  variables  must  be  added. 

It  should  be  noted  that  such  a 'fcoeff icient  reduction"  can  always 
be  performed,  but  the  "reduction"  is  cleanest  when  the  large 
coefficients  in  each  column  are  multiples  of  a  fixed  power  of  two, 
for  example. 


/3-274 

(-L274 

\2.274 


Theorem  1.  Let  L  be  a  linear  program  with  rational  coefficients 
whose  representation  requires  a  polynomial  number  of  digits.  Then  L 
may  be  expressed  using  integral  coefficients  of  2,  1,  -1,  and  0 
with  a  polynomial  number  of  variables  and  constraints. 
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Any  improving  column 

Standard  rule 

max  x. 

4 

xi  -  Bi  -  0 

replace 

X1  +  s2  *  1 

slacks  by 

-x^/3  +  *2  -  s^  =  0 

-  Sg/4 

x.,/3  +  x0  +  s,  =  1 

12  4 

s4/4 

-  x2/3  +  Xg  -  s^  *  0 

-  Sg/16 

x2/3  +  x^  +  Sg  *  1 

Sg/16 

-  x.j/3  +  x^  -  s7  =  0 

-  s^/64 

x3/3  +  x4  +  Sg  =  1 

V64 

Small  Coefficients 

Replace  a  quantity  like  Sg/64  by  a  variable  Sg,  along  with 
the  constraints 

^Sg  -  s£  -  0,  4s'g  -  s'"  =  0,  4Sg'  -  s8  =  0, 

all  variables  >  0  . 


Table  1:  Example  of  the  original  Klee-Minty  construction 
(upper  left),  a  scaling  of  the  slacks  to  fool 
the  standard  rule  (upper  right) ,  and  the  addi¬ 
tion  of  m(m-l)  variables  and  constraints  to 
yield  Integral  coefficients  4  (below). 


9 


proof.  The  may  be  made  to  be  0  or  1  by  suitably  multiplying 

each  row.  With  this  change,  let  d^  denote  the  least  common  multiple 
of  the  divisors  of  elements  in  column  j.  Then  column  j  may  be 
written  as 


x. 

J 

d. 

J 


where  d. ,  c, ,  a. . ,  . . . ,  a  .  are  integers.  Let  2  d^k)2k 
j  J  raj  J 

the  binary  representation  of  d^  and  let 


denote 


q  =  max  Ulog2  d^  J ,  llog2  a±;.  J  > 
i=  1 ,  • . . ,  m 


Note  that  d^  =  0  or  1  for  every  k,  j.  Define  a  new  variable 
-  -  (k) 

Xj  =  xj/dj  by  new  variables  xj  ,  k  =  0,  1,  2,  . . . ,  , 

(xfk)  =  2k  x.)  and  constraints  (2  dfk^  xfk^)  -  x4  =  0  and 


'j 


'j 


j 


-x4(k)  +  2i.(k_1)  ■■  0,  k  *  1,  . . . ,  q . .  Let  2  a(k)2k  be  the  binary 
j  J  J  k 

representation  of  a^j  ‘  Now  the  term  x^a^/d^  may  be  expressed 

as  2  a(k)  xf°.  All  coefficients  are  0,  +1,  or  2.  The  above 
k  ij  J 

construction  requires  2  (q.+l)  additional  variables  and  constraints. 

j  3 
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When  applying  the  simplex  method  to  the  above  problems,  care 

-*(k) 

must  be  taken  to  ensure  that  initial  pivots  eliminate  variables 

//\ 

and  retain  x^ .  If  x^  is  eliminated  and  replaced  by  x^  ,  a 
rescaling  of  variables  has  occurred  which  will  change  relative 
cost  factors  and  may  affect  the  pivot  sequence. 

The  following  theorem  notes  some  similarities  between  the  Klee- 
Minty  construction  and  the  "bad"  complementary  pivot  example  due  to 
Murty,  and  explains  how  the  Avis-Chvatal  example  was  obtained. 


Theorem  2.  Let  Ln  denote  the  n^  problem  constructed  on  the 
left  side  of  Table  1,  with  a^,  respectively,  82^  ^  replaced  by 
s2i/3i  1,  respectively, 

Then  fn  is  equivalent  to  a  resource  allocation  problem  with 
non-negative  integral  coefficients,  equal  objective  coefficients, 
and  basis  matrices  whose  determinants  are  1  or  -1. 


proof .  Solving  the  triangular  system 
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0 


X1 


-  S, 


*  0 


=  0 


0 


for  x, ,  • . . ,  x  yields 
1  n 


X1  *  S1 


VS3 
l2  3 


WS5 


il+a3+s5+a7 

27 


Substituting  for  x^  in  the  remaining  equations  produces  the 
equivalent  problem 


12 


maximize 


— j-  (Sl  +  S3  +  S5  +  S7  +  •••  +  8^) 


subject  to 


+  s. 


2sl+  S3 


+  8, 


2s^  +  2s^  +  s5 


2s^  +  2s^  +  2s,.  +  Sy 


+  s. 


+  s. 


9 

27 


2s,  +  2s_  +  2sc  +  2s_  +  • • *  +  s_  .+ 
1  j  5  /  zn-l 


+  s2u  =  3 


n-1 


Si  >  0  . 

The  constraint  matrix  is  of  the  form  (L|l)  where  L  is  a  lower  triangular 
matrix  with  ones  on  the  diagonal.  This  gives  the  result.  ■ 


The  above  problem  can  yield  the  same  pivot  sequence  as  the  n*"*1 
scaled  problem  in  Table  1  because  all  relative  cost  factors  will  be 
0  or  +  l/3n  at  every  vertex  (there  will  be  many  ties) .  To 
insure  that  the  same  sequence  is  followed  82^,  respectively,  Sj^ 
must  be  replaced  by 


S2i— l 

-~r  ,  respectively,  y 
k1_1  kx~A 


with  k  >  3  , 


in  which  case  the  constraint  matrix  would  change  but  would  remain 
lower  triangular. 
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An  example  of  Avis  and  Chvatal,  which  for  m  ■  3  with  a  rearranging 


of  indices  is 


maximize  10  s^  +  lOs^  +  s,. 


subject  to  s^ 
20s, 


+  s. 


+  3 


10 


10 


200s,  +  20s,  +  s, 
1  3  5 


+  s,  =  10 
o 


s±  >  0 


may  be  obtained  from  Table  1  by  replacing  the  3's  by  10' s  and  taking 
k  -  102. 

The  following  assertion  notes  that  a  bounded  pathological  example 
can  always  be  transformed  into  one  with  all  a^ ,  b^,  and  c^  _>  0. 

Assertion  1.  Let  L  be  a  linear  program  with  a  finite  optimal 
solution.  Then  L  may  be  transformed  to  an  equivalent  program  L' 
in  which  all  coefficients  are  positive  (non-negative) . 


Proof.  Affix  the  constraint  £x.  +  s  =  M  for  sufficiently 

■  i  Tti+i 

large  M.  Then  add  suitable  multiples  of  this  constraint  to  each 
row  until  all  coefficients  are  positive.  The  objective  function  will 
have  a  constant  term  involving  -M  which  may  be  disregarded.  b 
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r  •  ■ 

Bland’s  Rule  (first  improving  column) 

Table  2  lists  the  sequence  of  relative  cost  factors  c(s^) 

3 

associated  with  the  vertices  p^,  . ...  of  P  .  Notice  that  the 
variables  S2i  and  s2j_i  are  complementary,  i.e.,  S2£*S2£  l  “  ® 

V  i,  as  are  their  relative  cost  factors  c(s2i^  *  C(s2i-P  ■  0  V  i. 

The  following  theorem  notes  that  examples  given  in  Table  1  are 
pathological  for  Bland's  Rule.  A  similar  statement  can  be  made  for 
the  forthcoming  Jeroslow  modification,  and  for  network  examples  in 
[16]. 


Theorem  3.  The  examples  in  Table  1  follow  the  same  pivot  sequence 
with  Bland's  rule. 


Outline  of  proof.  It  suffices  to  show  that  the  first  improving 

column  prices  out  best.  Let  <f>  denote  the  objective  function. 

For  every  n,  4>(pQ)  =  0,  £(p2n_i)  =  1»  and  the  jump  in  $  between 

lower  and  upper  faces  is  1/3.  Let  p^  =  (p^,  <fi(p^)/3)  and 

2  ti 

pi  "  ^pi*  ^  for  0  £  i  2  -1.  Then  the  vertex  sequence 

,  n+1 

for  P  is 


11  1  2  2  2 
P0.  P1.  •••.  P2n-i»  P2IU1’  ’  pl’  p0 


^  v- 


lower  face 


upper  face 


For  each  increase  in  n,  the  objective  change  between  successive 
points  on  lower  (upper)  faces  decreases  by  a  factor  of  three.  Because 


Table  2:  Relative  cost  factors  associated 

with  the  vertices  Pg,  p.^,  p?. 


the  vertices  for  Pn+*  are  obtained  from  the  vertices  for  Pn  by 
adding  an  extra  dimension  (the  objective  value),  the  change  in  the 
entering  slack  required  to  move  from  to  on  the  lower 

(upper)  face  remains  the  same.  This  implies  that  relative  cost 
factors  for  old  slacks  are  decreased  in  absolute  value  by  a  factor 
of  three  for  each  increase  in  n.  The  new  slack  variables  (with  the 
highest  indices)  are  scaled  to  price  out  worse  than  the  other  variables. 
This  observation  and  its  predecessor  imply  that  the  lowest  indexed 
variables,  when  profitable,  price  out  best.  The  exact  formula,  for 
c(s2i)  >  0,  is  c(s  )  ■  4/3n  (3/4)*,  which  decreases  by  a  factor 
of  three  for  each  increase  in  n.  a 


I 

V 

l 

\ 


The  Maximum  Increase  Rule 


This  rule  enters  the  column  yielding  the  maximum  objective 
increase.  A  sequence  of  "bad"  polytopes,  r  ,  P°,  will  be 

constructed  recursively.  is  shown  at  the  top  of  Figure  2. 

It  has  two  dimensions,  four  faces,  and  requires  two  pivots  starting 
from  (0,0)  when  the  objective  is  maximize  x^.  The  two  "lower 

faces"  are  dotted  for  the  purposes  of  identification. 

2 

The  second  polytope  p  ,  is  four  dimensional  and  appears 
below  P^.  P2  is  a  deformed  product  of  P^  with  v\  the  two 
dimensional  polytope  shown  in  the  upper  right. 

P2  is  best  appreciated  by  imagining  that  one  is  looking  down 
at  the  top  of  a  mountain.  The  shaded  edges  of  P2  correspond  to 
the  upper  faces  of  P*  crossed  with  V*.  The  dotted  edges  of  P2 
correspond  to  the  bottom  faces  of  P*"  crossed  with  V1  and  are 
not  all  shown.  P^  corresponds  to  the  two  dimensional  polytope 
determined  by  (0,0)  and  points  a  and  b.  Figure  2  is  essentially 


an  approximate  projection  of 


are  denoted  x„  and  x, . 

3  4 


P2 


onto  the  V  coordinates,  which 


P2  was  designed  so  that,  starting  at  (0,0),  and  maximizing  the 
x^  or  "x"  coordinate,  one  first  performs  the  pivot  sequence  for  P* ; 
executes  several  pivots  involving  variables;  "reverses"  the 

sequence  for  P^ ;  and  ends  at  (1,0). 

In  terms  of  entering  slack  variables,  the  forward  pivot  sequence 
Pq  to  Pg  shown  in  Figure  2  may  be  expressed  as 


18 


Initial  polytope  & 


( V2 , 5/24 ) 


(Vg.  1/9) 


(0.0)  »pQ 


&2  «  9*  x  V1 

Coordinates  shown  are  X3  and  x4, 
the  coordinates  of  vV 


9* 

/  \ 


P8  =  (1,0) 


Forward  pivot  sequence  pg  to  pg  max  xg,  8  pivots. 


✓  \ 


Reverse  pivot  sequence,  pg  to  pg,  min  X3,  8  pivots. 


Figure  2:  A  modification  of  the  Klee-Minty-Jeroslow 
construction. 


S1S2 


S5S6S7 


s  s 
r  4 


r>j 


P  is  a  "reversible”  polytope,  in  the  sense  that  eight  pivots 
are  also  required  if  one  starts  at  (1,0)  and  minimizes  x^.  The 
reverse  pivot  sequence  from  (1,0)  to  (0,0)  is  shown  at  the 
bottom  of  Figure  2. 

To  insure  that  the  pivot  sequence  for  is  performed  before 

1 

variables  in  V~  are  entered,  the  difference  in  x  coordinates 
between  v^  =  (0,0)  and  =  (1/9,  1/9)  is  chosen  smaller  than 
the  difference  in  x  coordinates  between  (0,0)  and  vertex  a. 

This  ensures  that  pivots  involving  variables  of  P^  are  performed 
first  as  long  as  such  pivots  are  profitable. 
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Construction  of  PJ 


P3 


2  2  2 

is  constructed  as  a  deformed  product  of  P  x  v  .  V 


is  the  same  as  V  except  that  the  slopes  of  the  lines  through 

(-  1/3,  0),  (1/2,  5/24)  and  (1/2,  5/24),  (4/3,  0)  are  decreased 

in  absolute  value  by  a  factor  of  4.  This  effectively  squashes  the 
3 

top  half  of  P  so  that  the  difference  in  x  coordinates  between 

*  2 

Vq  and  v^  is  1/45  .  Variables  of  P  are  now  more  "profitable" 

2  2 
than  variables  of  V  ,  so  the  whole  pivot  sequence  for  P  is 

2 

performed  before  variables  of  V  are  entered. 

2 

Denoting  the  relevant  slacks  of  V  corresponding  to 


s5,  s6,  s?,  sg,  sg,  s1(. 


in  V  by  sn,  s^,  s^,  s^,  s^,  s^, 

3 

the  forward  pivot  sequence  for  P  in  terms  of  entering  slacks  is 


S1S2  S5S6S7  S3S4  S8  S11S12S13  S1S2  S10S9S8  S3S4  S7  S14 
v - -  - - /  v. _  _ , 


In  general,  P°  is  constructed  as  a  deformed  product  of  P11  1 
and  V°  3,  where  Vn  3  is  the  same  as  V3  except  the  lines  through 
(-  1/3,  0),  (1/2,  5/24)  and  (1/2,  5/24),  (4/3,  0)  have  their  slopes 
decreased  in  absolute  value  by  a  factor  of  l/4n  ^ . 


is  determined  by  the  intersection  of  lines  y  =  x  and  y  =  x/16  +  1/48. 
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Examples  with  Small  Coefficients 

1  2 

Constraints  with  small  Integral  coefficients  defining  P  ,  P  , 

and  are  shown  in  Table  3.  The  system  for  Pn  is  generated 

by  taking  the  system  for  Pn  ^  and  adding  the  constraints  determining 

V°  \  with  x2n_^  replaced  by  x2n_i“  ^x2n-3^  ^or  ^acets  on  tlie 

left  of  the  line  x2n_i  3  and  x2n_i  replaced  by  Xj  ^  +  (x2n  3^> 

for  facets  on  the  right  of  X2n  ^*1/2.  This  yields  the  deformation, 

or  tilting  of  the  product.  Note  that,  aside  from  a  translation  of 

2  1 

subscripts,  the  set  of  constraints  for  V  differs  from  that  for  V 
only  in  the  first  two  inequalities,  where  a  variable  x’^  (representing 
16x^)  has  replaced  a  variable  x^  (representing  4x^) .  This  corresponds 
to  reducing  the  slope  of  the  top  two  facets  by  a  factor  of  four. 


Testing  the  Problems 

To  run  the  problems  it  is  recommended  that  the  x  variables 
be  eliminated  and  replaced  by  slacks.  The  starting  basis  then  consists 
of  those  slacks  which  are  positive  at  the  point  (0,0,0,  ....  0). 

For  P^  the  starting  basis  would  be  s^,  s^,  s^,  Sg,  s^,  s^q,  and 
the  slacks  for  the  bottom  two  faces  of  V*. 
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max 


Table 


max  — x^  +  *2  —  0  ^ 

*\ 

- 

X1  X1  +  x2  —  1 

,  o 

>  2  pivots 

-x,  -  x„  <  0 

1  2  — 

X,  -  X-  <  1 

1  2  - 

max  x,  +  3x„ 

+  3x!  <  4 

1  3 

4  - 

x3  X1  ”  3x^ 

+  3x!  <  1 

4  — 

i 

/  2*2+4  =  8  pivots 

4x4  “  x4  s  0 

X1  “  ^x3 

+  3x.  <  0 

4  — 

x,  +  3x~ 

+  3x.  <  3 

1  3 

4  - 

X1  ‘  3x3 

<  0 

x^  +  3x^ 

<  3 

X1  -  3x3 

-  3x.’  <  1 

4  — 

x^  +  3x^ 

-  3x;  <  4 

max  x^ 

+  3x5 

3x"  <  4 

6  — 

X5  X3 

-  3x5 

+  3x6  <  1 

4x6 

-  x6  =0 

4x6  x6  =  ° 

X3 

"  3x5  +  3x6 

<  0 

X3 

+  3x^  +  3xg 

<  3 

x3 

-  3x5 

<  0 

x3 

+  3x^ 

<  3 

x3 

-  3x5 

‘  3x6  <  1 

x3 

4-  3x^ 

3x6  <4  - 

max 

x7 


+  3x 
-  3x 


7 

7 


^  mm  mm  f  __  f  |l  ..If  I 

V W WVW  8 


unrestricted 


24 


Acknowledgement 

The  author  would  like  to  thank  George  B.  Dantzig  for  numerous 
enlightening  conversations  and  Arthur  F.  Veinott,  Jr.  for  suggesting 
a  study  of  alternative  pivot  rules  which  ultimately  led  to  the 
"least  entered"  rule. 


25 


References 


[1]  D.  Avis  and  V.  Chvatal,  "Notes  on  Bland's  pivoting  rule".  Mathematical 

Programming  Study  8  (1978)  24-34. 

[2]  R.G.  Bland,  "New  finite  pivoting  rules  for  the  simplex  method",  Math¬ 
ematics  of  Operations  Research  2  (1977)  103-107. 

[3]  R.W.  Cottle,  "Observations  on  a  class  of  nasty  linear  complementarity 
problems".  Discrete  Applied  Mathematics  2  (1980) 

[4]  W.H.  Cunningham,  "Theoretical  properties  of  the  network  simplex  method". 

Mathematics  of  Operations  Research  2  (1979)  196-208. 

[5]  G.B.  Dantzig,  Linear  programming  and  extensions  (Princeton  University 
Press,  Princeton,  New  Jersey,  1963). 

[6]  Y.  Fathi,  "Computational  complexity  of  linear  complementarity  problems 
associated  with  positive  definite  symmetric  matrices".  Department  of 
Industrial  and  Operations  Engineering,  University  of  Michigan  (Ann  Arbor, 
Michigan,  1978). 

[7]  D.  Goldfarb  and  W.  Sit,  "Worst  case  behavior  of  the  steepest  edge  simplex 
method".  Discrete  Applied  Mathematics  1  (1979)  277-285. 

[8]  B.  Grilnbaum,  Convex  polytopes  (Interscience,  New  York,  New  York,  1967). 

[9]  R.  Jeroslow,  "The  simplex  algorithm  with  the  pivot  rule  of  maximizing 
criterion  improvement".  Discrete  Mathematics  4  (1973)  367-377. 

[10]  V.  Klee  and  G.J.  Minty,  "How  good  is  the  simplex  algorithm?".  Inequalities — 
III  (Academic  Press,  New  York,  New  York,  1972). 

[11]  V.  Klee  and  D.W.  Walkup,  "The  d-step  conjecture  for  polyhedra  of  dimension 

d  < 6  ",  Acta  Mathematics  117  (1967)  53-78. 

[12]  V.  Klee,  "A  class  of  linear  programs  requiring  a  large  number  of  iterations" 
Numerical  Mathematics  7  (1965)  313-321. 

[13]  T.M.  Liebling,  "On  the  number  of  iterations  of  the  simplex  method".  Methods 

of  Operations  Research  XVII  (1972)  248-264. 

[14]  K.G.  Murty,  "Computational  complexity  of  complementary  pivot  methods",  Math¬ 
ematical  Programing  Study  7  (1978)  61-73. 

[15]  W.P.  Niedringhaus  and  K.  Steiglitz,  "Some  experiments  with  the  pathological 
linear  programs  of  N.  Zadeh",  Mathematical  Programming  15(3)  (1978)  352-354 

[16]  N.  Zadeh,  "  A  bad  network  problem  for  the  simplex  method  and  other  minimum 
cost  flow  algorithms".  Mathematical  Programing  5  (1973)  255-266. 


26 


UNCLASSIFIED 


security  cl assification  of  this  p> of  fwh.n  d»i»  Ent»i4<f> 


REPORT  DOCUMENTATIOM  PAGE 


•  REPORT  NUMBER 


«.  TITLE  (*nd  Subtitle) 


WHAT  IS  THE  WORST  CASE  BEHAVIOR  OF  THE 
SIMPLEX  ALGORITHM? 


READ  INSTRUCTIONS 
DEFORF.  COMPLETING  FORM 


1  RECIPIENT'S  CATALOG  NUuaED 


5.  TVPE  Of  REPORT  A  PERIOD  COVERED 


TECHNICAL  REPORT 


(.  PERFORMING  ORG.  REPORT  HUMBER 


7.  AUThOR(».) 


«.  CONTRACT  OR  GRANT  NUMBERfO 


Norman  Zadeh 


N00014-7  5-C-0493 


»  PERFORMING  ORGANIZATION  NAME  ANO  ADDRESS 

DEPARTMENT  OF  OPERATIONS  RESEARCH 
STANFORD  UNIVERSITY 
STANFORD,  CALIFORNIA  94305 


II.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

LOGISTICS  AND  MATHEMATICAL  STATISTICS  BRANCH 
OFFICE  OF  NAVAL  RESEARCH 

ARLINGTON,  VIRGINIA  _ 


A.  MONITORING  AGENCY  name  6  ADORES Sf If  dltlkrmnt  Horn  Controlling  O/flcpJ 


10.  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  a  WORK  UNIT  NUMBERS 

NR-042-264 


12.  REPORT  OATE 

Mav  1.  1980 


IS.  NUMBER  OE  PAGES 

26 


IS.  SECURITY  CLASS,  (of  Kilo  r.ptmj 


UNCLASSIFIED 


IS«.  DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 


16.  DISTRIBUTION  STATEMENT  (of  rhlt  K.poilJ 

This  document  has  been  approved  for  public  release 
Its  distribution  is  unlimited. 


and  sale. 


17.  DISTRIBUTION  STATEMENT  (of  ffio  mbalrmct  onforacf  fn  Block  20.  It  dlltkrfil  from  Rmporl) 


IB.  SUPPLEMENTARY  NOTES 

Also  partially  supported  by  National  Science  Foundation  Grant  ENG76-12266. 


19.  KEY  WOROS  (Continue  on  rtvtttt  tidt  l(  noctttory  tnd  Identify  by  block  nuatbtr) 


Simplex  method,  pathological,  pivot,  polytope,  diameter 


JP.  ABSTRACT  (Continue  on  ttvtttt  tfdt  It  ntctttmry  ond  tdtntlty  by  block  nuwbif) 

The  examples  published  by  Klee  and  Minty  in  1972  do  not  preclude  the 
existence  of  a  pivot  rule  which  will  make  the  simplex  method,  at  worst, 
polynomial.  In  fact,  the  continuing  success  of  Dantzig's  method  suggests 
that  such  a  rule  does  exist. 

A  study  of  known  examples  shows  that  a)  those  which  use  "selective" 
pivot  rules  require  exponentially  large  coefficients,  and  b)  none  of  the 


DO  I  JAN  71  1473  EDITION  OF  I  NOV  65  II  OBSOLETE 
S/N  0102*014  -  6601  ’ 


UNCLASSIFIED 

SECURITY  CLASllf  ICATI0N  OF  THU  RAGE  (»•"  D»f»  6"  !•••*> 


r 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  PAOEfWlaw  P»t«  Bnlmrtd) _ 

20.  Abstract  (continued) 

examples'  pivot  rules  are  typically  used  in  practice,  either  because  of  computa¬ 
tional  requirements  or  due  to  a  lack  of  even-handed  movement  through  the  column 
set. 

In  all  "bad"  problems,  certain  improving  column  are  entered  about  2m~^  times 
before  other  improving  columns  are  entered  once.  This  is  done  by  making  the 
unused  columns  "appear"  to  yield  small  objective  function  improvement. 

The  purpose  of  this  paper  is  to  explain  the  Klee-Minty  and  Jeroslow  construc¬ 
tions,  show  how  they  can  be  modified  to  be  pathological  with  small  integral  coef¬ 
ficients,  and  then  suggest  a  "least  entered"  pivot  rule  which  forces  an  improving 
column  to  be  entered  before  any  other  column  is  entered  for  the  second  time. 

This  rule  seems  immune  to  the  "deformed  product  construction"  which  is  the 
essence  of  all  known  exponential  counterexamples. 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  RAGEfWTiMi  D Mo  tnttiti) 


